home
***
CD-ROM
|
disk
|
FTP
|
other
***
search
/
kermit.columbia.edu
/
kermit.columbia.edu.tar
/
kermit.columbia.edu
/
newsgroups
/
misc.20041116-20060924
/
000220_fdc@columbia.edu_Wed Dec 14 14:47:53 2005.msg
< prev
next >
Wrap
Internet Message Format
|
2006-09-27
|
3KB
Path: newsmaster.cc.columbia.edu!not-for-mail
From: Frank da Cruz <fdc@columbia.edu>
Newsgroups: comp.protocols.kermit.misc
Subject: Re: c-kermit8 and slow http downloads
Date: 14 Dec 2005 19:47:44 GMT
Organization: Columbia University
Lines: 52
Message-ID: <slrndq0tn0.77a.fdc@sesame.cc.columbia.edu>
References: <adZnf.57226$Tf5.41708@newsread1.mlpsca01.us.to.verio.net>
Reply-To: fdc@columbia.edu
NNTP-Posting-Host: sesame.cc.columbia.edu
X-Trace: newsmaster.cc.columbia.edu 1134589664 28322 128.59.59.56 (14 Dec 2005 19:47:44 GMT)
X-Complaints-To: postmaster@columbia.edu
NNTP-Posting-Date: 14 Dec 2005 19:47:44 GMT
User-Agent: slrn/0.9.8.0 (SunOS)
Xref: newsmaster.cc.columbia.edu comp.protocols.kermit.misc:15467
On 2005-12-14, Matt SF <mattsf@example.com> wrote:
: I know we're not supposed to say kermit is slow, but for my http
: downloads, it appears to be! :)
:
: I wrote to kermit-support but on second thought I probably shouldn't
: have bothered them without asking here first. so here goes:
:
: I have been using c-kermit on Solaris 8 recently with some scripts for
: file push and retrieval. For push, I'm doing ftp scripting. For
: retrievals, I'm using the http command set. They both work well in a
: scripting environment.
:
: One thing I notice though, doing an 'http get' on a file only gives me a
: download speed of about 16kB/s. Using 'wget' on the same file and same
: webserver, it comes down at over 200kB/s.
:
: I've tried my binary, a pre-compiled binary, using 'fast' on the kermit
: command line....I just can't figure out why it's running at such a slow
: download speed.
:
: My version is 8.0.211, Solaris 8, gcc, default compile options.
:
: Anyone have some ideas on how I can improve the speed? Thank you!
:
I checked this locally just now. There does indeed seem to be some slowness
in Kermit's HTTP GET. Downloading a 2MB file with Kermit HTTP I get 50K cps,
versus 1002K cps with Kermit FTP from/to the same hosts. Slower by a factor
of 20. On the other hand, I have had similar reports about Kermit FTP, which
seem to happen only to certain people and not to anybody else. So maybe
it's a universal problem with the HTTP code, or maybe it's particular to
certain circumstances.
I invite anybody who feels like an afternoon of fun to take a look at the
routine http_get() in ckcnet.c. It's best if you look at the current working
version of the code:
http://www.columbia.edu/kermit/ckdaily.html
A quick glance at the code shows there are two scenarios: chunked and
non-chunked. The server announces which method to use. The non-chunked
method looks like it might be really slow. Suggestion: add a debug() clause
here:
} else if (!ckstrcmp(buf,"Transfer-Encoding:",18,0)) {
if ( ckindex("chunked",buf,18,0,0) != 0 )
chunked = 1;
}
to see which method was used. If non-chunked, probably what's needed is
a whole new layer of buffering.
- Frank